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Abstract —Multi-agent networks are often modeled as in¬ 
teraction graphs, where the nodes represent the agents and 
the edges denote some direct interactions. The robustness of a 
multi-agent network to perturbations such as failures, noise, 
or malicious attacks largely depends on the corresponding 
graph. In many applications, networks are desired to have 
well-connected interaction graphs with relatively small number 
of links. One family of such graphs is the random regular 
graphs. In this paper, we present a decentralized scheme for 
transforming any connected interaction graph with a possibly 
non-integer average degree of k into a connected random m- 
regular graph for some m £ [k,k + 2]. Accordingly, the agents 
improve the robustness of the network with a minimal change 
in the overall sparsity by optimizing the graph connectivity 
through the proposed local operations. 

I. Introduction 

Multi-agent networks have been used to characterize a 
large number of natural and engineered systems such as 
biological systems, financial networks, social networks, com¬ 
munication systems, transportation systems, power grids, and 
robotic swarms. Multi-agent networks are often represented 
via their interaction graphs, where the nodes correspond to 
the agents and the edges exist between the agents having 
some direct interaction. Various system properties such as 
the robustness, mixing time, or controllability of a network 
greatly depend on the structure of the corresponding graph 
(e.g., [1], [2], [3], [4], [5]). Therefore, graph theoretic analy¬ 
sis of networked systems has received a considerable amount 
of attention during the last decade (e.g., [6], [7]). 

In many applications, multi-agent networks face various 
perturbations such as component failures, noise, or malicious 
attacks. One of the fundamental measures that capture the ro¬ 
bustness of networks to such perturbations is the connectivity 
of the corresponding graph. A graph is said to be fc-node 
(or -edge) connected if at least k nodes (or edges) should 
be removed to render the graph disconnected. In general, 
graphs with higher connectivity have higher robustness to 
the targeted removal of their components [1], [2]. For many 
networks, well-connected interaction graphs provide robust¬ 
ness to not only the structural failures but also the functional 
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perturbations such as noise (e.g., [8], [9]). Connectivity can 
also be quantified via some spectral measures such as the 
algebraic connectivity [10] or the Kirchhoff index [11]. An 
arguably richer measure of connectivity is the edge (or 
node) expansion ratio (e.g., [12], [13]). If the expansion 
ratio of a graph is small, then it is possible to disconnect 
a large set of nodes by removing only a small number of 
edges (or nodes). Graphs with high expansion ratios are 
called expanders. A detailed overview of expanders and 
their numerous applications can be found in [14] and the 
references therein. 

The connectivity of a network can be improved by adding 
more edges to the graph. However, each edge stands for 
some communications, sensing, or a physical link between 
the corresponding agents. Hence, more edges require more 
resources. Moreover, too many edges may lead to higher 
vulnerability to the cascading failures such as epidemics 
(e.g., [15], [16]). Consequently, having a small number of 
edges (i.e., sparsity) is desired in many applications. One 
family of well-connected yet sparse graphs is the random 
regular graphs. A graph is called an m-regular graph if the 
number of edges incident to each node (the degree) is equal 
to m. A random m-regular graph of order n is a graph that is 
selected uniformly at random from the set of all m-regular 
graphs with n nodes. As n goes to infinity, almost every 
m-regular graph is an expander for any m > 3 [13], [17]. 

In this paper, we present a decentralized scheme to 
transform any connected interaction graph into a connected 
random regular graph with a similar number of edges as the 
initial graph. Some preliminary results of this work were 
presented in [18] and [19], where any initial graph with 
an integer average degree, k £ N, was transformed into a 
random /e-regular graph. In this paper, we extend our earlier 
works to obtain a method that is applicable to the most 
generic case, i.e. k £ R. The proposed method transforms 
any graph with a possibly non-integer average degree of k 
into a random m-regular graph for some m £ [k,k + 2], As 
such, the graph becomes well-connected, regardless of the 
network size. 

The organization of this paper is as follows: Section [n] 
presents some related work. Section [III] provides some graph 
theory preliminaries. Section [IV] formulates the problem 
and presents the proposed solution. Section [V] provides a 
distributed implementation and an analysis of the resulting 
dynamics. Section VI provides some simulation results to 
demonstrate the performance of the proposed solution. Fi¬ 
nally, Section VII concludes the paper. 




II. Related Work 

In some applications, the robustness of a graph is related 
to the centrality measures such as the degree, betweenness, 
closeness, and eigenvector centralities. Loosely speaking, the 
centrality measures capture the relative importances of the 
nodes in a graph. Detailed reviews on the centrality measures 
and their applications can be found in [20], [21] and the 
references therein. Typically, the perturbations applied to the 
nodes with higher centrality scores have a stronger impact 
on the overall system (e.g., [22], [23], [24], [25]). Hence, 
graphs with unbalanced centrality distributions are usually 
vulnerable to such worst-case perturbations. 

In the literature, there are many works related to the 
construction of robust interaction graphs. Some of these 
works consider how a robustness measure can be improved 
via some modifications to the graph topology. For instance, 
such improvement can be achieved by rewiring a small 
percentage of the existing edges (e.g., [26]) or adding a small 
number of edges to the graph (e.g., [27], [9]). 

Another group of studies consider the explicit construc¬ 
tion of expanders. Expanders can be constructed via graph 
operations such as zig-zag product (e.g., [28], [29]), or 
derandomized graph squaring [30], Furthermore, for any 
to € N such that to— 1 is a prime power, an explicit algebraic 
construction method for a family of m-regular expanders, i.e. 
Ramanujan graphs, was presented in [31]. In [32], Watts- 
Strogatz small-word networks are transformed into quasi 
Ramanujan graphs by rewiring some of the edges. 

Expanders can also be built as random m-regular graphs. 
A detailed survey of the various models of random regular 
graphs as well as their properties can be found in [33] and 
the references therein. As n goes to infinity, almost every m- 
regular graph has an algebraic connectivity arbitrarily close 
to to — 2 y/m — 1 for m > 3 [13], [17]. For regular graphs, 
high algebraic connectivity implies high expansion ratios 
(e.g., [34]). Hence, for any fixed to > 3, a random m- 
regular graph has the algebraic connectivity and expansion 
ratios bounded away from zero, even if the network size is 
arbitrarily large. 

A random m-regular graph with n nodes can be con¬ 
structed by generating to copies for each node, picking a 
uniform random perfect matching on the nm copies, and 
connecting any two nodes if the matching contains an edge 
between their copies (e.g., [35], [36]). In [37], the authors 
present a distributed scheme for incrementally building ran¬ 
dom 2m-regular multi-graphs with to Hamiltonian cycles. 
Alternatively, some graph processes may be designed to 
transform an initial m-regular graph into a random ?n-regular 
graph by inducing a Markov chain with a uniform limiting 
distribution over the set of ?n-regular graphs (e.g., [38], [39]). 
The method in this paper is also based on designing a graph 
process with a uniform limiting distribution over the set of 
to- regular graphs. Compared to the similar works in the 
literature, the proposed scheme is applicable to the most 
generic case, and it is decentralized. The initial graph is 
not required to satisfy some strong properties such as being 


regular or having an integer average degree. Furthermore, the 
global transformation is achieved via only some local graph 
operations. 

III. Preliminaries 

An undirected graph, Q = IV, E), consists of a set of 
nodes, V, and a set of edges, E, given by unordered pairs of 
nodes. A graph is connected if there exists a path between 
any pair of nodes. A path is a sequence of nodes such that 
an edge exists between any two consecutive nodes in the 
sequence. Any two nodes are said to be adjacent if an edge 
exists between them. We refer to the set of nodes adjacent 
to any node, i £ V, as its neighborhood, A/], defined as 

M = {j\ (i,j)£E). (1) 

For any node i, the number of nodes in its neighborhood 
is called its degree, di, i.e., 

di = |M|, (2) 

where |A/j denotes the cardinality of M l . For any graph Q, 
we use 5(G), A (G) and d(G) to denote the minimum, the 
maximum, and the average degrees, respectively. We refer 
to the difference of the maximum and the minimum node 
degrees in a graph as the degree range, f(G), he. 

f(G) = A(G)-5(G). (3) 

For any undirected graph, G = ( Vi E), the graph Lapla- 
cian, L, is a symmetric matrix whose entries are given as 

( di if i= j, 

(L]ij = \ -1 if (i,j)£E, (4) 

[ 0 otherwise. 

The second-smallest eigenvalue of the graph Laplacian is 
known as the algebraic connectivity of the graph, a(G). 

Local graph transformations can be represented using the 
framework of graph grammars (e.g., [40]). A grammar, $, 
is a set of rules, where each rule is defined as a label- 
dependent graph transformation. Each rule is represented as 
an ordered pair of labeled graphs, r = (gi,g r ), where the 
labels represent the node states. Graph grammars operate 
on labeled graphs. A labeled graph, G = ( V,E,l ), consists 
of a node set, V, an edge set, E, and a labeling function, 
I : k 4 S, where £ is the set of feasible node labels. A rule 
is said to be applicable to a labeled graph, G = (V, E, l), if G 
has a subgraph isomorphic to gi, i.e. if there is a bijection, 
which preserves node labels and edges, between gi and a 
subgraph of G ■ A rule, r = ( gi,g r ), transforms any graph 
isomorphic to gi to a graph isomorphic to g r . A labeled 
initial graph, (1(0), along with a grammar, <1>, defines a non- 
deterministic system represented as (f/(0),<I>). 

IV. Decentralized Formation of Random 
Regular Graphs 

A. Problem Formulation 

Motivated by the connectivity properties of almost every 
m-regular graph for to > 3, this paper is focused on the 



following problem: Assume that a multi-agent network is 
initialized with an arbitrary connected interaction graph. How 
can the agents reconfigure their links locally in a decentral¬ 
ized fashion such that the resulting dynamics transform the 
interaction graph into a connected random regular graph with 
a similar sparsity as the initial graph? Such a transformation 
is illustrated in Fig. |T| 



Fig. 1. A fragile interaction graph (a) with an average degree 2.8 is trans¬ 
formed into a random 3-regular graph (b). The graphs have similar sparsities, 
whereas the structure in (b) has a significantly improved connectivity. 


In order to transform the interaction graph into a random 
regular graph, the agents need to pursue three global ob¬ 
jectives: 1) balance the degree distribution, 2) randomize 
the links, and 3) drive the average degree to an integer 
close to its initial value. Furthermore, the agents should 
ensure that the graph remains connected as they modify 
their links. This paper presents a set of locally applicable 
graph reconfiguration rules to pursue all of these global 
objectives in parallel. In the remainder of this section, we 
will incrementally build the proposed scheme using the 
framework of graph grammars. 

B. Degree Balancing 

As the first step towards building random regular graphs, 
we present a local rule for balancing the degree distribution 
in a network while maintaining the connectivity and the 
total number of edges. The degree balancing task can be 
considered as a quantized consensus problem (e.g., [41], 
[42]), where each local update needs to be realized via some 
local changes in the structure of the graph. In this part, we 
design a single-rule grammar, for balancing the degree 
distribution. In each node is labeled with its degree, i.e. 

l(i) = di, Vi e V. (5) 

The proposed grammar, is defined as 




where di, dj, and dh denote the degrees of the corresponding 
nodes. 


In accordance with <h /? , nodes behave as follows: Let i and 
j be any pair of adjacent nodes. If dj<d i, then a new link 
is formed between j and an arbitrary neighbor of i, say h, 
that is not currently linked with j. At the same time, the link 
between i and h is terminated to maintain the overall sparsity. 
Note that if dj < di, then i has at least one such exclusive 
neighbor, h. Furthermore, if a connected graph is not regular 
then there always exists at least one pair of adjacent nodes, 
i and j, such that di > d. j. Hence, any connected graph is 
stationary (i.e., «1 >r is not applicable anywhere on the graph) 
if and only if it is a regular graph. Moreover, any concurrent 
application of on a connected graph, Q, maintains the 
connectivity and the average degree of Q. 

A detailed analysis of the dynamics induced by <1> r can 
be found in [18], where it is shown that the degree range, 
f(G), monotonically decreases and converges to its minimum 
feasible value under As such, the graph converges to 
a regular graph (i.e., f(Q) = 0) if the average degree is 
an integer. Otherwise, f(G) converges to 1. For the sake of 
brevity, we skip the details of this analysis and only provide 
its main result in Theorem 14.11 


Theorem 4.1 Let 0(0) be a connected graph and let r = 
{0(0),0(1),...} be a feasible trajectory of (0(0),$^). 
Then, Tf = {/(0(0)), /(0(1)), • ■ •}, almost surely converges 
to an integer, r}, such that 


0 i/d(0(O))GN 

1 otherwise, 


(6) 


where d(G( 0)) denotes the average degree o/0(O). 


The grammar <1» r transforms any connected graph with 
an integer average degree, k £ N, into a connected k- 
regular graph. Note that, although almost every fc-regular 
graph is an expander for k > 3, <l> r may still result in a rare 
configuration with an arbitrarily small expansion rate. For 
instance, both of the 3-regular graphs in Fig. [2] are stationary 
under <t> r whereas the graph in Fig. [2}i can have half of the 
network disconnected due the failure of a single edge or a 
single node. The probability of converging to an undesired 
equilibrium such as the graph in Fig. [2ji depends on the initial 
graph. In the next part, we will build on <1> r to avoid such 
undesired outcomes. 



Fig. 2. A poorly-connected 3-regular graph (a) and a well-connected 3- 
regular graph (b). 






C. Link Randomization 


along with the following result can be found in [19]. 


In order to ensure that the interaction graph does not 
converge to a poorly-connected configuration, we extend <&r 
by adding a second rule for randomizing the links between 
the agents. The purpose of this additional rule is to induce a 
uniform limiting distribution over the set of all connected k- 
regular graphs instead of having the network converge to 
an element of that set. As such, the resulting graph will 
be a random fc-regular graph. A locally applicable method 
was introduced in [39] for transforming regular graphs into 
random regular graphs. We define an additional rule for 
based on this method. The resulting grammar, &rr, uses the 
same labels as and it is defined as 




where di, dj , dh, and df denote the degrees of the corre¬ 
sponding nodes. In accordance with Qrr, if a node has more 
links than one of its neighbors has, then it rewires one of its 
other neighbors to its less-connected neighbor (ri). Also, 
adjacent nodes exchange their exclusive neighbors (r 2 ). 

Both rules in <f> r r maintain the number of edges and 
the connectivity. Unlike <!>/;, a connected graph is never 
stationary under <l >rr (unless it is a complete graph). Once 
a regular graph is reached, n is not applicable anymore, but 
the agents keep randomizing their links via r 2 . 

There may be many feasible concurrent applications of 
rr on an interaction graph. In such cases, the agents 
need to execute one of the alternatives randomly. These 
randomizations do not have to be uniform, and assigning 
each alternative a non-zero probability is sufficient for the 
desired limiting behavior to emerge. We provide Algorithm 
[T]as a such distributed implementation that leads to a uniform 
limiting distribution over the set of connected fc-regular 
graphs. 

Algorithm |T| is memoryless since each iteration only 
depends on the current graph, and the probability of any 
feasible transition is independent of the past. As such, it 
induces a Markov chain, Prr, over the set of connected 
graphs with the same average degree as the initial graph, i.e. 

Gn,k = {G = (V,E)\\V\=n,\E\ = ^}, (7) 

where fc = d(Q( 0)). Let k C G n> k be the set of connected 
fc-regular graphs. Note that if k G N, then k ^ 0. A 
thorough analysis of the dynamics induced by Algorithm [I] 


Theorem 4.2 Let satisfy k £ N. Then, Prr, has a 
unique limiting distribution, p*, satisfying 




0 otherwise. 


( 8 ) 


Algorithm I: Distributed Implementation of <&rr 

i 

initialize: Q = ( V, E) connected, e G (0,1) 

2 

repeat 

3 

Each agent, i, is active with probability 1 — e. 

4 

Each active i picks a random j G A fi. 

5 

For each i, Ri = { i ' G J\fi \ i picked i}. 

6 

for (each (i,j) s.t. i G Rj,j G Ri, di > dj ) 

7 

max{i, j} picks a random r G <&rr. 

8 

if (r = 7 * 1 , di > dj, |i?i| > 2) 

9 

i picks a random h G Ri \ {j}. 

10 

if t(j,h) f E ) 

11 

E = (E\{(i,h)})U{(j,h)}. 

12 

end if 

13 

else if (r = r2, |-Ri > 2, |Rj| > 2) 

14 

i picks a random h G Ri\{j}. 

15 

j picks a random / G Rj\ 

16 

if {(i,f)<£E,(j,h)<fE) 

17 

E = {E\{(i,h), {j, /)}) U {(*, /), (j, h)}. 

18 

end if 

19 

end if 

20 

end for 

21 

end repeat 


In light of Theorem |4.2| any connected initial graph with 
an integer average degree, fc G N, can be transformed into a 
connected random fc-regular graph via <1> rr. For any fc > 3, 
such graphs have their algebraic connectivity and expansion 
ratios bounded away from zero, even when the network size 
is arbitrarily large. If fc ^ N, then the degree range converges 
to 1 via n, as given in Theorem |4.1| In that case, the limiting 
graph can be loosely described as a random almost-regular 
graph. While such graphs have many structural similarities to 
random regular graphs, there is not an exact characterization 
of their expansion properties. In the next part, we will build 
on <b r r to obtain a grammar that produces random regular 
graphs, even when fc ^ N. 

D. Average Degree Manipulation 

Both <f>xj and <I> r r were designed to maintain the overall 
network sparsity. In order to obtain random regular graphs 
even when the initial graph has a non-integer average degree, 
fc ^ N, the agents need to manipulate the total number of 
edges. To this end, the sparsity constraint should be relaxed 
to allow for occasional increases and decreases in the number 
of edges as long as the graph is not regular and the average 
degree is within some proximity of its initial value. Also, 
the feasible range of the number of edges should ensure that 
the average degree can reach an integer value. Since an m- 
regular graph with an odd number of nodes does not exist 















if m is odd, an even integer should always exist within the 
feasible range of the average degree. In this part, we derive 
such a grammar, $*, by building on &rr. 

In $*, each node, i £ V, has a label, /(«), consisting of two 
elements. The first entry of the label is equal to the degree 
of the node, just as in <1> r and <1' rr. The second entry of 
l(i) is a binary flag that denotes whether the corresponding 
agent is allowed to locally increase or decrease the number 
of edges in the network. A node, i, can add an extra edge to 
the graph only if uq = 0 , and it can remove an edge only if 
w, = 1. As such, the node labels are defined as 


*(0 


di 

Wi 


,V*£U, 


(9) 


breaks one edge of a triangle if all of its nodes do not have the 
same degree and one of the higher degree nodes has its binary 
flag equal to 1. Note that the total number of edges decreases 
in that case, and the binary flag of the corresponding higher 
degree node becomes 0. The final rule, r 4 , is for exchanging 
the binary flags among adjacent nodes. The purpose of r 4 
is to ensure that the edge additions and removals will be 
applicable as long as they are needed to drive the average 
degree to an integer. In the remainder of this section, the 
dynamics induced by <E>* is analyzed. 

Lemma 4.3 Graph connectivity is maintained under any 
concurrent application of $*. 


where di denotes the degree of i, and w;, £ {0,1}. For any 
graph, the degree of each node is already encoded through 
the edge set, E. Hence, for the sake of simplicity, a labeled 
graph will be denoted as Q = { V. E, w ) in the sequel. Using 
the node labels given in (|9|, the proposed grammar, <f>* = 
{ri,r 2 ,r 3 ,r 4 }, is defined as 



The rules in <f>* can be interpreted as follows: The first 
rule, ri, is a variant of the degree balancing rule in < 1 ' rr. 
While rq induces a transformation identical to the degree 
balancing rule in $rr with a probability, 1 — /3, there is 
also a nonzero probability, /?, that if the higher degree node 
has its binary flag equal to 0 , then it maintains its link with 
the neighbor introduced to its lower degree neighbor. Note 
that the total number of edges increases in that case, and the 
binary flag of the corresponding higher degree node becomes 
1. The second rule, yq, is the same link randomization rule 
as in Qrr. The third rule, r 3 , is the edge removal rule which 


Proof: Let a connected graph Q(t) be transformed into 
Q(t + 1) via some concurrent application of <f>*. Since Q(t) is 
connected, for every pair of nodes, v,v' £ V, Q(t) contains 
a finite path P between v and v'. If all the edges traversed 
in P are maintained in Q(t + 1), then P is also a valid path 
on Q(t + 1). Otherwise, any missing edge is removed due 
to an execution of rq, r 2 , or 7 - 3 . Accordingly, the following 
procedure can be executed to transform P into a valid path 
on Q(t + 1 ) between the same terminal nodes as P: 

For each edge that is traversed in P but missing in Q(t +1), 

1) If the edge was removed via rq or r 3 , then replace the 
corresponding part of the path, {i, h }, with {i,j, h}. 

2) If the edge was removed via r 2 , then replace the 
corresponding part of the path, {r, h} (or {j, /}), with 
{i,j,h} (or 

Consequently, if Q(t) is connected, then Q(t + 1) is also 
connected. 

■ 

Note that, unlike <t> r and <l> rr, the the number of edges is 
not maintained under >!>* due to the possible edge additions 
and removals. However, the number of edges is bounded in 
an interval through the binary labels, w. 

Lemma 4.4 Let Q = {V, E, w) be a graph, and let r be any 
feasible trajectory of (Q, <!>*). For any Q' = (V, E ', w') £ r, 

\E'\-\E\ = l T w' -l T w, (10) 

where 1 is the vector of all ones. 

Proof: 

Let Q(t) = (V,E(t),w(t)) and Q(t + 1) = (V,E(t + 
1 ), tu(f+l)) be a pair of consecutive graphs on any trajectory, 
r, of ((?,<!>*). Note that the number of edges is maintained 
under r 2 and r±, and it can increase by 1 only due to r\ or 
decrease by 1 only due to r 3 . If an application of rq adds an 
extra edge to the network, then one of the nodes involved in 
that transformation, i, satisfies Wi(t+1)—Wi(t) = 1, whereas 
the other two participating nodes maintain their w entries. On 
the other hand, for each application of r 3 , one of the nodes 
involved in that transformation, i, satisfies uq(t+l)—Wj(f) = 
— 1 while the other two participating nodes maintain their w 
entries. Furthermore, any rule application that maintains the 
number of edges also maintains the sum of w entries of the 























participating nodes. In particular, any edge rewiring via rq 
or any neighbor swapping via r 2 maintain the w entries of 
the participating nodes, whereas any label exchange via r,\ 
maintains the sum of labels. Hence, E(t) and E(t+ 1) satisfy 

| E(t + 1)| - \E(t)\ = 1 T w{t + 1) - 1 T w(t). (11) 

Using induction, it can be shown that CD implies ( flQ| ) for 

any Q' = (V, E', w') £ r. ■ 


Corollary 4.5 Let Q = ( V, E, 0) be a graph, and let 
t be any feasible trajectory of ((/,$*). For any Q' = 
(' V,E',w')£t, 

\E\ < \E'\ < \E\ + \V\. (12) 


Proof: Let Q = (Vj E, 0) be a graph, and let r be any 
feasible trajectory of (Q, $*). In light of Lemma 4.4 every 
Q' = (V,E',w') £ t satisfies 


| E'\ - \E\ = l T w' - 1 T 0 = 1 T w'. 


(13) 


Since each entry of w is either equal to 1 or equal 0, 

0 < l T w' < \V\. (14) 

Hence, ( fL3j ) and ( | 1 4[ > together imply ( fl2| ). ■ 

Corollary |4.5| provides the upper and the lower bounds on 
the of number of edges along any trajectory of (5,$*) for 
any Q = ( V, E, 0). Lemma |4~6| shows that the corresponding 
interval always contains a value that implies an integer 
average degree. 


Lemma 4.6 For any Q = (V', E), a graph, Q' = ( V,E'), 
satisfying d{Q') £ N can be formed by adding at most |Vj 
edges to Q. 


Proof: Let Q = (V, E) be a graph, and let Q' = (Vj E') 
be a graph that is formed by adding t] edges to Q. Then, 


d{Q') 


m+rj) 


(15) 


For any Q = ( V. E), there exists unique pair of integers, 
p,q £ N, such that 0 < q < \V\ and 


\E\=p\V\+q. (16) 

Let r)* = |Vj — q. Note that rf < \V\ since 0 < q < |Vj. 
Furthermore, by plugging rf into ([T5|, we obtain 


2(|-E'| + V*) 


2 p -f- 2 




+ 2 - 



2(p+l). (17) 


Since p £ N, we have 2 (p + 1) £ N. Hence, for any Q = 
(V,E), there exists 0 < rj < rf such that a graph, Q' = 
(Vj E'), satisfying d(Q') £ N can be obtained by adding r/ 
edges to Q. ■ 

In light of Lemma |4.6[ the interval in ( fl2| ) always has at 
least one value implying an integer average degree. Next, it 
is shown that (Q, $*) almost surely reaches a regular graph 
for any connected Q = (V,E, 0) such that d{Q) > 2. 


Lemma 4.7 Let Q = (V, F. w) be a connected graph such 
that d(Q) N. If l T w < \V\, then Q can be transformed via 
4>* into a graph, Q' = (V, E r ,w r ), satisfying \E'\ = \E\ + 1. 

Proof: If d(Q) (j N, then Q has to be a non-regular 
graph. Furthermore, since Q is connected, then there has 
to be at least a pair of neighboring nodes, i and j, with 
different degrees. Without loss of generality let d t > dj. 
Then, i should have at least one neighbor that is not linked 
to j. As such, n is applicable on Q = ( V, F). Furthermore, 
since each entry of w is either 0 or 1, at least one entry of w 
is equal to 0 if 1 T w < | Vj. If Wi = 0, then an extra edge can 
be added to the graph via r\ with probability f. If 0, 
then there exists another node, i', such that Wi> = 0. Apply 
t "4 along the shortest path between i and i' to obtain = 0. 
Once Wi = 0 is obtained, then with probability ti an extra 
edge can be added to the graph in accordance with r\ to 
obtain a graph, Q' = (V, E', w'), satisfying \E'\ = \E\ + 1. 


Lemma 4.8 Let Q = (V, F, w) be a connected triangle-free 
graph. If d(Q) > 2, then Q can be transformed via 4>* into 
a graph, Q' = (V,E',w), containing at least one triangle. 

Proof: Let Q = (V, E , w) be a connected triangle- 
free graph. Since d(Q) > 2, Q has to be a cyclic graph. 
Consider the shortest cycle on Q, C s . Note that C s has to 
contain at least 4 nodes, since Q is triangle-free. Furthermore, 
if d(Q) > 2, then C s cannot contain all the nodes of Q, as 
otherwise Q has to be a cycle graph with d(Q) = 2. Also, 
since Q is a connected graph, at least one node on C s must 
be linked to a node that is not contained in C s . Without loss 
of generality, let i be a node on C s connected to an off-cycle 
node, h. Furthermore, let j denote a neighbor of i on C s . 
Note that h can not be connected to j since Q is triangle-free. 
Furthermore, since the C s contains at least 4 nodes, j has to 
have another neighbor on C s , f, which is not connected to 
i. If i and j execute r 2 by rewiring h and / to each other, 
C s becomes a shorter cycle. Note that w is invariant under 
t '2 ■ Hence, by repeating this process until C s consists of 3 
nodes, Q can be transformed into a graph, Q' = (V,E',w), 
containing at least one triangle. ■ 


Lemma 4.9 Let Q = (Vj F. w) be a connected graph such 
that d(Q) N. If l T w > 0 and d{Q) > 3, then Q can be 
transformed via ( I>“ into a graph, Q' = (Vj E', w'), satisfying 
\E'\ = \E\-l. 


Proof: Let Q = (Vj E, w) be a connected graph such 
that d(Q) N. Since d(Q) ^ N, the degree range can be 
reduced to 1 without changing d and w via r\, as given 
in Theorem 4.1 Furthermore, in light of Lemma 4.8 if the 
resulting graph is triangle-free, then it can be transformed 
via 7"2 into a graph, Q + = (Vj E + ,w), which contains at 
least one triangle. Since A((? + ) — 5(G + ) = 1 and d(Q + ) = 
d(Q) > 3, we have S(Q + ) > 3. 

If 1 T w > 0, then at least one entry of w is equal to 
1. As such, Wi = 1 can be reached for any i £ V via a 







sequence of 7-4 applications. Hence, if any of the triangles in 
G + involves nodes with non-uniform degrees, then one edge 
of the triangle can be broken in accordance with r :i to obtain 
a graph, Q' = (V,E r ), satisfying \E'\ = \E\ — 1. 

On the other hand, assume that all the triangles on Q + 
consist of nodes with uniform degrees. Let i, j, and h be the 
nodes of such a triangle. Consider the shortest path from any 
node of this triangle to a node whose degree is not equal to 
the degrees of the triangle nodes. Without loss of generality, 
let this path be between i and i' such that df, f 1 df. Note 
that each node other than i' on this path has its degree equal 
to df, and either d+ > df or df < df. Both cases are 
inspected below: 

1) If c if > df, then df > 4 given that <5(f/ + ) > 3. 
Hence, the node next to i' on the shortest path has at least 
one neighbor outside the shortest path that is not connected 
to if. Applying rq by rewiring such a neighbor to i' results 
in a shorter path from j to a smaller degree node. Applying 
the same procedure eventually results in a smaller degree 
node being adjacent to i. Since df > 4, i has at least 
one neighbor other than j and h to rewire to its smaller 
degree neighbor. After the corresponding application of r -\, 
we obtain a triangle of nodes with non-uniform degrees. 
Hence, one edge of the triangle can be broken in accordance 
with r 3 to obtain a graph, Q' = (V,E',w'), satisfying 
\E'\ = \E\-l. 

2) If df < df, then i! can apply rq to rewire one of 

its neighbors to the node on the shortest path next to itself. 
This results in a shorter path from i to higher degree node is 
obtained. Applying the same procedure eventually increases 
the degree of i, and we obtain a triangle of nonuniform 
degrees. Hence, one edge of the triangle can be broken in 
accordance with r 3 to obtain a graph, Q' = ( V,E’,w '), 
satisfying \E'\ = \E\ — 1. ■ 


Lemma 4.10 Let Q = (V, E, 0) be a connected graph. If 
d(G) > 2, then (Q, <E>*) almost surely reaches an m-regular 
graph such that d(G) < m < d(G) + 2. 


Proof: Let Q = (V, E. 0) b e a connected graph such 
that d(G) > 2. Due to Corollary 
stays in {|£j, \E\ + 1,... \E\ + 


4.5 


the number of edges 


Vj} along any trajectory 


of (G, d?*). In light of Lemma 4.6 this interval contains at 


least one value, \E\ + p, such that the corresponding average 
degree, to, is an integer satisfying 


d{G) < m = 


m\+v) 


< d(G) + 2. 


(18) 


As such, to > 3 since d(G) > 2 . Let G' = (V,E',w') be 
a graph reached from G via <f>* such that d(G') f N. Then, 
either \E'\ < \E\ + p or \E'\ > \E\ + 77 . Both cases are 
inspected below: 

1) If \E'\ < \E\ + p, then 1 T w' = \E'\ - \E\ < \V\. As 


such, in light of Lemma 4.7 G' can have its number of edges 
increased by 1 via <f>*. This process can be repeated unless 
the average degree reaches an integer value. 


2) If \E'\ > | E\ + p, then l T w' = \E'\ - \E\ > 0. 
Furthermore, d(G') > 3 since to > 3. As such, in light 
of Lemma |4.9[ G' can have its number of edges decreased 
by 1 via 4>*. This process can be repeated unless the average 
degree reaches an integer value. 

Hence, in either case it is possible to add or remove edges 
to the network via <I>* until the number of edges implies 
an integer average degree, to £ \d(G),d(G) + 2]. Once an 
average degree of to is obtained, then the graph can be 
driven to a m-regular configuration through a sequence of 
ri applications. As such, any G' has a non-zero probability 
of reaching an m-regular graph after a finite sequence of <f>* 
applications. Consequently, (G, < L‘) almost surely reaches an 
?n.-regular graph such that d(G) < m < d(G) + 2. ■ 

Unlike <I>and the degree range does not monotoni- 
cally decrease under <h' due to the possible edge addition and 
removals. For instance, increasing the total number of edges 
via ri would increases the degree range if dh = A (G) and 
6(G) < dj. However, if a regular graph is reached, then the 
graph remains regular since neither r\ nor r : > are applicable 
on a regular graph. 


Lemma 4.11 Let G be an m-regular graph. Any feasible 
trajectory of (G , <&*) consists of only m-regular graphs. 


Proof: On an m-regular graph, n and 7-3 are not appli¬ 
cable since di = dj for any pair of nodes, 7 . j. Furthermore, 
since the node degrees are invariant to the applications of 
r '2 and 74 , any feasible trajectory of (G■ f l>") consists of only 
m-regular graphs. ■ 

Once an m-regular graph is reached, the graph evolves 
only under r^ and 7 ^ 4 . As such, it keeps randomizing within 
the corresponding set of m-regular graphs. The induced 
limiting distribution depends on how the agents implement 
4>*. In the next section, we present a distributed implemen¬ 
tation that leads to a uniform limiting distribution over the 
corresponding set of m -regular graphs. 


V. Distributed Implementation 

In this section, we present Algorithm [II] as a distributed 
implementation of <!>" and analyze the resulting dynamics. 

In accordance with Algorithm [D] the nodes behave as 
follows: At each iteration, each node is inactive with a 
probability, e £ (0,1). The inactivation probability, e, ensures 
that any feasible application of ( l>” can be realized through 
Algorithm [II] as it will be shown in Lemma 5.1 Inactive 
nodes do not participate in any rule execution in that time 
step. Each active agent, i, picks one of its neighbors, j £ M % , 
uniformly at random, and it communicates its degree to that 
neighbor. Through these communications, each active agent, 
i, obtains the list of neighbors that picked itself, R, C A";, 
and checks if it is matched, i.e. if j £ Ri. If that is not the 
case, then i is a follower in that time step, i.e. it will not 
initiate a rule execution but it will participate if j wants to 
rewire i to some other node. If j £ Ri, then i and j are 
matched. Each matched pair randomly pick a candidate rule, 
r £ $*, that they will potentially execute. In Algorithm [II] 










without loss of generality, the candidate rule is picked by the 
agent with the larger node ID, i.e. max{i, j}. Depending on 
the chosen rule, r£$*, the matched pair of nodes, i and j, 
do one of the following: 

1) r = r\\ If di > dj and |i?j| > 2, then i chooses a 
neighbor, h ^ j £ Ri, uniformly at random. If h (f-_ 
Afj, then, with probability 1 — /3, h is rewired to j. 
With the remaining probability /3, if u;, =0, a link is 
formed between h and j, the link between i and h is 
maintained, and w[ = l. 

2) r = r 2 : If \Rj\ > 2 , both i and j choose one 
neighbor, h ^ j £ Ri and / ^ i £ Rj, uniformly at 
random. If neither h nor / is linked to both i and j, 
then r 2 is executed by rewiring h to j and / to i. 

3 ) r = r 3 : If di > dj, Ri > 2), and Wi = 1, then i 
chooses a neighbor, h ^ j £ R,, uniformly at random. 
If h £ Afj, then the link between i and h is removed 
and w\ = 0 . 

4) r = r±: i and j swap their binary flags, i.e. w[ = Wj 
and w'j = Wi. 

A feasible iteration of the algorithm on a network is illus¬ 
trated in Fig. [ 3 ] where Q = ( V. E , w) is transformed into 
G' = (V, E 1 , w') in one time step. 


Algorithm II: Distributed Implementation of <I>* 

1 : 

initialize: Q = ( V,E,w = 0) connected, e,/3 G (0,1) 

2 

repeat 

3 

Each agent, i, is active with probability 1 — e. 

4 

Each active i picks a random j G Afi. 

5 

For each i G V, Ri = { i' G Afi \ i' picked i}. 

6 

for (each (i, j) s.t. i G Rj,j G Ri, di > dj) 

7 

ma x{i,j} picks a random r G $*. 

8 

if (r = ri, di > dj, |i?i| > 2) 

9 

i picks a random h G Ri \ {j}. 

10 

if <Sj,h)$E) 

11 

i picks a random /?' G [0,1]. 

12 

if 03' > /3) 

13 

E = (E\{(i,h)})U{(j,h)}. 

14 

else if {wi = 0 ) 

15 

E = E U {(j, h,)}, Wi = 1. 

16 

end if 

17 

end if 

18 

else if (r = ri, |i?i| > 2,\Rj\ > 2) 

19 

i picks a random h G Ri \ {j}. 

20 

j picks a random / G Rj \ {z}. 

21 

if Hi,f)iE,{j,h)iE) 

22 

E = (E\{(i,h),(j,f)})U{(i,f),U,h)}. 

23 

else if (r = 7 * 3 , di > dj, |i?i| > 2 , Wi = 1 ) 

24 

i picks a random h G Ri \ {7}- 

25 

if ({j, h) E E) 

26 

E = E\ {(i, h )}, Wi = 0. 

27 

end if 

28 

else if (r = r 4 ) 

29 

Swap Wi and Wj. 

30 

end if 

31 

end for 

32 

end repeat 


W2 = 0 Wi = 0 Wq = 0 



8 ) W 8 = 0 


W3 = 0 w 5 = 0 W 7 = 0 


(a) 

I w.p. e(l - e) 7 n 4 

▼ 8 CLi 




Fig. 3. Some steps of a feasible iteration of Algorithm [TT] on Q in (a) 
resulting in Q r in (c) along with the probabilities of the corresponding events. 
In this example, each node other than 8 is active and picks a neighbor as 
illustrated in (b), where each arrow is pointed from a node to its chosen 
neighbor. Accordingly, (1,3) and (4,6) are the matched pairs. With a joint 
probability of 1/16, node 3 picks r±, and node 6 picks 7*2 as the candidate 
rules for their respective matchings. Furthermore, since R 3 \ {1} = {5}, 
R 4 \ {6} = {2}, and Rq \ {4} = {7}; node 3 picks node 5; node 4 picks 
node 2; and node 6 picks node 7 to rewire. Finally, the edge between node 
3 and 5 is maintained with a probability /3 (103 = 0). Hence, given (b), Q’ 
can emerge with a probability of /3/16. 


Note that Algorithm [II] maintains connectivity due 


to 


Lemma 


4.3 


Let k = G?(f/(0)) be the average degree of the 
initial graph, Cy (0) = (V, E(0),0). Then, the average degree 
remains in [k, k + 2] due to Corollary 4.5 Furthermore, 
Algorithm |U] is memoryless since each iteration only depends 
on the current graph, and the probability of any feasible 
transition is independent of the past. Hence, it induces a 
Markov chain over the state space, ,[fc,fc+ 2 ], consisting of 
connected labeled graphs with n nodes and average degrees 
contained in [fc, k + 2], i.e. 


G n ,[ fc!fc+2 ] = {G = ( V,E,w ) | |V| = n, \E\ = 0.5kn+l T w}, 

(19) 

where Wi £ {0,1} for every i £ V. 

Let /x(£) denote the probability distribution over the state 
space at time t. Then, /u(f) satisfies 


/r r (£ + l) =fi T (t)P*, (20) 


where P* is the corresponding probability transition matrix. 
Accordingly, the probability of transition from any Q to any 
Q’ is denoted by P*(G,G')- 

By following Algorithm[II] the agents concurrently modify 















their neighborhoods in accordance with 4>* such that any 
feasible transformation occurs with a non-zero probability. 
In other words, for any pair of graphs, G,G' £ Gn,[fe,t+2], 
the corresponding transition probability, P*(G,G'), is non¬ 
zero if it is possible to transform G into G' in a single time 
step via <b*. 


Lemma 5.1 Let G,G' £ < R r n,[k,k+ 2 ] be any pair of graphs. 
If G' can be reached from G in one step via $*, then 

P*(G,G')> 0. 

Proof: 

Let G' be reachable from G in one step via <!>*, and let 
G = {fji , ry 2 , ■ ■ ■} denote the corresponding set of disjoint 
subgraphs of G to be transformed to reach G'■ Note that 
for each g £ G there is a r = ( gi 7 g r ) £ <f>* satisfying 
g ~ gi. In order to show that P*(G,G') > 0, we present a 
feasible flow of Algorithm [II] that transforms G by applying 
the corresponding r £ 4>* to each g £ G. For each g £ G, 
let each node in q be active and pick a neighbor as illustrated 
in Fig. [4] 





(d) 


Fig. 4. An arrow is pointed from each agent to the neighbor it picked. 
For each g E G, the nodes in g have non-zero probability to pick their 
neighbors as shown in (a) if r = r\, (b) if r = 7 * 2 , (c) if r = r%, and (d) 
if r = r 4 . 


Furthermore, let any node that is not included in any g £ G 
be inactive, which ensures that only the subgraphs in G will 
be transformed. Finally, let each g pick the corresponding 
r as the candidate ruler to execute. In that case, the agents 
are guaranteed to only apply the corresponding r £ 4>* to 
each g £ G. Hence, the corresponding transformation has a 
non-zero probability in P*. 


The state space, can be represented as the 

union of two disjoint sets, G° j fc fc+2 j (regular graphs) and 
G+ (non-regular graphs), defined as 


®n,[fc,fc+2] — e < &n,[k,k+2] I f (G) — 0}, (21) 

G n,[fc,fc+2] = G n,[fc,t+2]\ G n 1 [fc,t+ 2 ]- ( 22 ) 


In light of Lemma 


4.10 


< ^’n,[k,k+2] 7^ 


for k > 2. Let M 


denote the set of all such to, i.e. 

M = {to £ N \ k < m < fc + 2,0.5?n|V| e N}. (23) 

The set of regular graphs, G° fc+2 p can be written as 
the union of some disjoint sets as 


< ^n,[fc,fc+2] — U 


(24) 


mEM 


where each G° m is the set of m-regular graphs defined as 

G°, ro = {G £ <G°, [fe , fc+2] I d{G) = m}. (25) 

In the remainder of this section, the limiting behavior of 
P* is analyzed. In light of Lemma 4.10 if k > 2, then any 
connected f/(0) = (V,E( 0), 0) almost surely converges to 
G° r fc fc+2 j . Next, we show that, for each m £ M, G° m is a 
closed communicating class. 


Lemma 5.2 If k > 2, then G® m is a closed communicating 
class of P* for each m £ M. 


Proof: In Light of Lemma 4.1 1| only r 2 and r 4 is 
applicable on any m-regular graph, and any resulting graph 
is m-regular. Hence, once the system reaches any G? m , it 
stays in G° m . Furthermore, in light of Theorem 4.2 any 


m-regular structure can be reached from any other via r 2 . 
Moreover, since all the graphs in G° m are connected, any 
permutation of the elements in w is also reachable via r,\ for 
each graph structure in G° rn . Hence, each G° m is a closed 


communicating class of P*. ■ 

The limiting behavior of Algorithm [II] depends on the 
limiting behavior of P* in each closed communicating 
class. Note that for each G° m , there is a unique stationary 
distribution, p^, of P* whose support is G° m . Next, it is 
shown that each pf is a limiting distribution that is uniform 
over G° m . To this end, first it is shown that the transitions 
between any two regular graphs are symmetric. 


Lemma 5.3 For any m £ M, let GiG’ £ G° m be any pair 
of m-regular graphs. Then, 

P*(G,G') = P*(G',G). (26) 

Proof: For any m £ M, let G, G' £ G° m be any pair 
of m-regular graphs. Note that r\ and 7-3 are not applicable 
on any graph in G° m since all the nodes have equal degrees. 
Hence, any transition from G to G' is only via r 2 or r 4 . Since 
both r 2 and r 4 are reversible, P*(G,G') > 0 if and only if 

P*(G',G)> 0. 

Let us consider an arbitrary execution of Algorithm [II] 
where G is transformed into G'■ Let u be the corresponding 
vector of randomly picked neighbors in line 4 of Algorithm 
[II] (let Ui = nidi if i is inactive). For each node, i, let 
Ri(u) be the set of nodes that picked i, and let M(u) = 
{( i,j ) | i £ Rj(u),j £ Ri(u)} be the set of matched 
pairs. In the remainder of the proof, it is shown that for 
any such feasible execution there exists an equally likely 
execution of Algorithm [H| that transforms G' back to G■ For 
G' = (V, E',w r ), consider the vector, u!, whose entries are 













ui if Ui = null or ( i,m ) £ E ', 

u,, otherwise. 


(27) 


Note that Pr[tt] = Pr[xx'] since the inactive nodes will 
remain inactive with the same probability, and each active 
node picks a neighbor uniformly at random. Furthermore, 
M(u) = M(u'). Let each (i.j) £ M{u) randomly choose 
the same candidate rule, r, they executed in the transition 
from Q to Q'. As such, if r = r 4 , then i and j will swap 
Wi and Wj back. On the other hand, if r = 7 ~ 2 , then i and j 
will reverse the neighbor-swapping in the transition from Q 
to Q’ with the same probability (lines 12-17 in Algorithm |Ii|) 
since |i?i(w)| = |f?i(V)l and |-fiy(it)| = for every 

(i,j) £ M(u). As such, all the local transformations from 
(7 to Q’ can be reversed with the same probability under 
Algorithm [n] Consequently, P* ((7, §’) = P*((7', (7). ■ 


Lemma 5.4 For any m £ M, there is a unique limiting 
distribution, p^, of P* satisfying 

0 


tC@) = 


ifSeGlm, 

otherwise. 


(28) 


Proof: For any m £ M, G° 
ing class due to Lemma 


is a closed communicat- 


5.2 


As such, for each G° m , there 
exists a unique stationary distribution, p^, whose support is 
G°, m . Let P * be the |G°, J by |G°_ J probability transition 
matrix that only represents the transitions within G° m . Due 
to Lemma |5.2| Pf is irreducible. Also Pf is aperiodic 
since P*((7,f7) > 0 for every Q (for instance, there is a 
non-zero probability of all the nodes being inactive). As 
such, the corresponding stationary distribution, /if, is a 


limiting distribution. Furthermore, due to Lemma 5.3 P, 


is symmetric, and it is consequently doubly stochastic. As a 
result, p^ is uniform over G° m . 


Theorem 5.5 For any connected Q = (V, E, 0) satisfying 
d(Q) > 2, P* leads to a limiting distribution, pg, given as 

P*g = E Pr t£ JaC (29) 

mGM 

where Pr[(7 —> G° m ] is the probability that the chain 
initialized at Q ever enters the set of m-regular graphs, 
G° . m , and each /xj^ is uniform over its support, G° m . 

Proof: Due to Lemma pf, 1 0| the Markov chain initial¬ 
ized at any connected Q = (V,E, 0 ) satisfying d(Q) > 2 
almost surely enters a closed communicating class of m- 
regular graphs, G° m , such that m £ M. Furthermore, each 
G° m has a uniform limiting distribution, as given in 
Lemma [ 5 G] Hence, P* leads to the convex combination of 
limiting distributions, /x^, where each /x^ is weighted by 
the probability that the chain starting at Q ever enters G° m . 

■ 

In light of Theorem |5.5| Algorithm|n]asymptotically trans¬ 
forms any connected initial graph, Q = (V, E. 0), satisfying 


d(Q) > 2 into a random m-regular graph for some m £ M 
as given in ( |23j ). When M is not a singleton, the probability 
of reaching each G° m depends on the initial graph as well as 
the algorithm parameters e, fj £ (0,1). However, the graphs 
observed in the limit are guaranteed to be expanders since 
d{Q) > 2 implies m > 3 for every m £ M. 

VI. Simulation Results 

In this section, we present some simulation results for the 
proposed scheme. An arbitrary connected graph, (7(0) = 
(V,E, 0), is generated with 100 nodes and 135 edges. As 
such, the initial average degree is d((7(0)) = 2.7. The 
interaction graph is evolved via Algorithm [n] with e = /3 = 
0.01 for a period of 100000 steps. Since d{G{ 0)) = 2.7, 
the average degree is guaranteed to remain in [2.7,4.7] for 
any feasible trajectory, as given in Corollary |4.5| Since the 
number of nodes is even, both integers in this interval are 
feasible values for the average degree, i.e. M = {3,4}. 
In light of Theorem |5.5[ the graph is expected to become 
either a random 3-regular graph or a random 4-regular graph. 
In the presented simulation, the graph reaches a 3-regular 
graph after 45123 time steps. Note that once the system 
enters G5 00 3 , both /((7(f)) and d(Q(t)) are stationary. Fig. 
[ 5 ] illustrates (7(0) and (7(100000), which have the algebraic 
connectivities of 0.02 and 0.25, respectively. The values of 
the degree range, /((7(f)), and the average degree, d(G(t)), 
for the first 50000 steps are illustrated in Fig. [6] Once a 
3-regular graph is reached, the graph keeps randomizing 
in G^qo 3 via r 2 and rq. The evolution of the algebraic 
connectivity throughout this simulation is shown in Fig. [7] 
As expected from random 3-regular graphs, the algebraic 
connectivity of the network is observed to be at least 3—2\/2 
with a very high probability after a sufficient amount of time. 

VII. Conclusions 

In this paper, we presented a decentralized graph reconfig¬ 
uration scheme for building robust multi-agent networks. In 
particular, we focused on the connectivity properties of the 
interaction graph as the robustness measure. Accordingly, we 
provided a decentralized method for transforming interaction 
graphs into well-connected graphs with a similar sparsity as 
the initial graph. More specifically, the proposed solution 
produces random m-regular graphs in the limit. Such graphs 
are expanders for any m > 3, i.e. they have the algebraic 
connectivity and expansion ratios bounded away from zero 
regardless of the network size. 

The proposed method was incrementally built in the paper. 
First, a single-rule grammar, was designed for balancing 
the degree distribution in any connected network with an 
initial average degree k. *I>x? transforms the initial graph into 
a connected fc-regular graph if k £ N. If k (j N, then the 
degree range converges to 1 via «1 >;j. Next, <1 'n was extended 
to ensure that the interaction graph does not convergence to 
a poorly-connected fc-regular graph. To this end, a local link 
randomization rule was added to 4>/,■. The resulting grammar, 
transforms the initial graph into a connected random 
/c-regular graph if fc £ fj. Finally, <1' /,■/,’ was extended to 






obtain random regular graphs in the most general case, i.e. 
even when k ^ N. For any k > 2, the resulting grammar, 
<1> , leads to a connected random ?n-regular graph such that 
to £ [k,k + 2], Note that k > 2 implies m > 3. Hence, 
the corresponding random to- regular graphs are expanders 
with a similar sparsity as the initial graph. Some simulation 
results were also presented in the paper to demonstrate the 
performance of the proposed method. 
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(a) (b) 

Fig. 5. Agents transform the initial interaction graph in (a), which has an average degree of 2.7, into a random 3-regular graph such as the one in (b) by 
following Algorithm [TT] 





Fig. 6. The average degree, d(Q(t)), and the degree range, for the first 50000 time steps of the simulation. Once a regular graph (i.e., 

= 0) is reached, both d(Q(t)) and remain stationary under Algorithm |5| 



time (t) 


Fig. 7. The algebraic connectivity, as the initial graph in Fig. [5Ji evolves via Algorithm |5| After a sufficiently large amount of time, a(Q(t)) 

rarely drops below 3 — 2\/2 (marked with a horizontal solid line), as expected from random 3-regular graphs. 






































